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ABSTRACT 

During the 1989-90 school year, 978 adult learners 
received basic and remedial instruction at the 19 sites of the adult 
basic education (ABE) program of the School District of the City of 
Saginaw (Michigan). The program's objectives were specifically aimed 
at adults who are urban residents from high unemployment areas, rural 
residents, members of minority groups, limited in English abilities, 
over age 60, handicapped, immigrants, incarcerated, or women with 
special needs. Six of the program's 11 objectives were met during the 
1989-90 school year, a decrease from the previous year when 8 of 11 
objectives were met. However, two of the program objectives — setting 
educational objectives for 100 percent of the participants who 
received 12 or more instructional hours and the standard of 15 
percent of the participants being rural — may have been 
inappropriately high. The program die* not meet its standard for 
student achievement. Only handicapped students met the performance 
standards ; incarcerated , English-as-a-Second-Language , senior 
citizens, and regular ABE students did not. It was recommended that 
program staff should: (1) seek ways to provide services to homeless 
persons; (2) consider ways to modify program objectives that seem 
unrealistic; (3) determine what may have caused the extreme decline 
in performance among incarcerated students, *4) review the reporting 
procedures for accuracy; and (5) standardize classroom operations. 
(KC) 
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INTRODUCTION 

The Adult Basic Education (ABE) program of the School District of the 
City of Saginaw recently completed its 29th year of operation. The program, 
administered by the Office of Adult and Continuing Education, is designed to 
meet the educational needs of adults who have less than an eighth grade educa- 
tion. It provides basic and remedial instruction in reading, writing, and 
arithmetic as well as in Michigan Life Role Competencies (MLRC), English as a 
Second Language (ESL), Adult Bilingual, and Pre-General Educational Develop- 
ment (Pre-GED). 

The ABE program serves a diverse population. It has program goals and 
objectives specifically aimed at adults who are: 

• Urban residents from high unemployment areas, 

• Rural residents f 

• Members of minority groups, 

• Limited in English abilities, 

• Over 60, 

• Handicapped, 

• Immigrants, 

• Incarcerated, and 

• Women with special needs. 

Enrollment in ABE is open throughout the year. Upon enrolling, each 
student's needs are identified. An individualized educational plan (IEP) , 
which focuses on those needs and establishes educational objectives for that 
student, is drawn up. The teacher to whom that student is assigned writes 
that plan with the student* 

During 1989-90, 978 students received services by attending one or more 
of the 51 classes conducted in the 19 centers located throughout Saginaw. 
(Appendix A contains a list of the names and addresses.) These classes wre 
designed to be taught in a traditional manner wherein three instructional 



topics (reading, mathematics, and MLRC) were to be taught on a daily basis and 
the entire class would be working on assignments within the same topic* 

Students from all of the groups cited above received ABE services during 
the year. Demographic data (racial/ethnic, gender, and age breakdowns) on 
this year's student population can be found in Appendix B. 

In 1989-90, the ABE staff consisted of one program supervisor, 24 
teachers (21 full-time and three part-time), one full-time student advisor, 
seven teacher aides (four full- and three part-time), and two secretaries (one 
full- and one part-time). In addition, there were 32 voluntary literacy 
tutors . 
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PRODUCT EVALUATION PROCEDURES 

This evaluation will address program performance relative to the goals 
and objectives stated in the 1989-90 ABE grant. (A process evaluation 
focusing on whether the program was operating as intended was conducted during 
the year; its results were published under a separate cover.) 

ABE data were recorded by the ABE teachers on the "Adult Basic Education 
Objective Reporting Form" (Appendix C contains a copy). These sheets were 
collected by the program supervisor every eight weeks. During a first 
semester staff inservice, the supervisor stressed to the staff the importance 
of having the^e sheets fully artf timely completed. 

The supervisor provided the additional Information and documentation 
necessary to examine program performance. 

These data v*re compared to the standards mandated in the grant. 



PRESENTATION OF THE DATA 

The ABE data were analyzed with respect to the criteria specified for 
each objective of the grant. The following sections will present the findings 
of these analyses. 

STUDENT ENROLLMENT 

The grant specified enrollment goals for seven ABE student classifica- 
tions. Table 1, below, presents these classifications, their respective goals 
and enrollment figures, and whether the standards were attained. 



TABLE I. ABE STUDENTS BY POPULATION CLASSIFICATION 

1989-90. 



Population 
(N-978) 



Minima 

Percent 
Enrollment 
Standard 



Nuaber and Percent 
of Participants* 



Attainment 
Of Standard 



Adults With Limited 
English Language 
Skills 

Unempl oyed 

Rural 

Hand 1 capped 

Minority 

Female Heads of 
Households/ 
ADC Recipients 

Homeless 



10 

15 
15 
10 
75 
15 

10 



115 

612 
71 
30 
788 
306 

0 



1 1.8 

62.6 
7.3 
3. 1 
80.6 
31. 3 

0.0 



Yes 

Yes 

No 

No 

Yes 

Yes 

No 



*Figures reflect duplicated counts. 
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By examining Table 1, it can be seen that the program attained its 
enrollment objectives for four of the seven classifications (^7. IX) 1 . 

DROPOUT PREVENTION 

The grant specified that the ABE prjgram was to attain a dropout rate at 
or below 40% from among the students who received at least 12 hours of 
instruction. In the last two years (1987-88 and 1988-89) this standard was 
attained . 

A review of year-end data indicated that 436 (4 5.0%) of the 968 students 
receiving 12 hours or more of instruction (see Table 2, below) dropped out of 
the program. The dropout prevention standard was not attained . 

RECRUITMENT 

Prior to the 1988-8S school year, a recruitment campaign was conducted 
for the ABE program. The campaign consisted of the distribution of bulletins 
containing general information about the program (e.g.. class offerings and 
locations, and phone numbers to call for information). 

The major goals of the recruitment campaign were to attract new students 
to the program and to motivate previous students to return. The standard set 
in the grant was that at least 10% of the student population be new to the 
program. According to enrollment data, 523 (53.5%) students were new. The 
standard wa s met . 



It should be pointed out that a standard of 15% rural students may not be 
realistic for an ABE program operating in an urban environment. 

2 

A dropout is defined as a student who leaves the program for a reason 
other than employment, passing the General Educational Development (GED), 
completing his/her ABE objectives, or death. 
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STUDENT ACHIEVEMENT 
Background 

The progran tracks the achievement of five student classifications. 
These five are: handicapped, ESL (bilingual)* incarcerated, senior citizen, 
and regular (those not classifiable in the other four categories) • Individual 
ABE objectives were to be assigned to any student receiving 12 hours or more 
of instruction and 75% of those students, within classification and across the 
program, were to attain mastery on at least 75% of their objectives * 

This Tear 

A review of the records demonstrated that 968 adult learners received at 
least 12 instructional hours. Tabl* 2, below, is a presentation of students, 
by classification and total, who received 1 2 or more hours of instruction and 
the number and percent of them who were assigned objectives. 



TABLE 2. NUMBER Of ABE STUDENTS, BT PROGRAM CLASSIFICATION AND TOTAL, 
WHO RECEIVED 12 OR MORE HOURS OP INSTRUCTION AND THE NIMBER 
AND PERCENT WHO WERE ASSIGNED OBJECTIVES, 1989-90. 



Classification 


Umber Becelving 
12 or More Hours 
of Instruction 


Assigned 
N 


Objectives 
Z 


Hand icapped 


31 


31 


100.0 


ESL (Bilingual) 


97 


93 


95. 9 


Incarcerated 


71 


71 


100.0 


Senior Citizen 


78 


76 


97.4 


Regul ar 


691 


685 


99. 1 


Program Total 


968 


956 


98.8 
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As can be seen in Table 2 above, 956 (98. 8%) of the students who were 
provided 12 hours or more of instruction were assigned individual objectives. 
Thus, while this portion of the program objective was not attained literally, 
it ould be argued that it was attained functionally. Further, this 
represents a substantial improvement over last year when objectives were 
assigned to only 89.5% of those students who received 12 hours or more of 
instruc tlon. 

In reference to student performance, Table 3 below, presents the number 
and percent of students (who received both 12 hours of instruction and 
individual objectives), by classification and program total, who mastered at 
least 75Z of their individual objectives. (Table D. 1, in Appendix D presents 
a quartile distribution of objective attainment by student classification and 
total. ) 

TABLE 3. NUMBER AND PERCENT OP ABE STUDENTS, BY PROGRAM CLASSIFICATION 
AND TOTAL, WHO ATTAINED THE STANDARD* IN 1989-90. 



Participant 
Classification 



Students Assigned 
Objectives and 
Receiving 12 or 
More Hours of 
Instruction 



Attained Standard* 
N Z 



Program 
Performance 
Standard** 
Attained? 



Handicapped 


31 


26 


63.9 


Yes 


ESL (Bilingual) 


93 


67 


72.0 


No 


Incarcerated 


71 


27 


3 8.0 


No 


Senior Citizen 


76 


51 


68.9 


No 


Regular 


685 


360 


52.6 


No 


Program Total 


956 


531 


55.5 


No 



*A<;taining mastery on 75% of their individual objectives. 
* ^Seventy-five percent of the students will attain the standard. 



A review of Table 3 reveals the following: 



# The program standard was met by the handicapped students. 



• The progran standard was not met by students in any of 
the other categories. 



• Total pr,gran results indicate that overall tho perform 
ance standard was not met. 



Even though this standard was not achieved, an examination of Table D. 1 
reveals that, program wide, 75.1% of the ABE students attained at least 50% of 
their objectives (i.e., 24.9% mastered less than 50% of their objectives). 
Similar success rates were evident within all but one category, ranging from 
74.7% (among regular ABE students) to 93.6% (among handicapped students) 
attaining at least 50% of their objectives. Among incarcerated students, only 
42.3% attained at least 50% of their objectives. 

Longitudinal 

A three year comparison of student performance data was conducted. 

As to the first portion of the objective, in each year, less than 100% 
of those students receiving 12 or more hours of instruction were assigned 
objectives. The actual numbers and percent s of students for each year are 
specified below. 



A three year review of the number and percent of students (who received 
both 12 hours of instruction and individual objectives), by classification and 
program total, who met the standard (mastering 75% of their objectives) is 
presented in Table 4, below. 



Year 



N 



1987- 88 

1988- 89 

1989- 90 



875 
904 
956 



86.1 
89.5 
98.8 
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TABLE 4. NUMBER AND PERCENT OF ARE STUDENTS, BY CLASSIFICATION 
AND TOTAL, WHO MET THE STANDARD* IN 1987-88, 
1988-89, AND 1989-90. 



Y-ar 

Participant 



Classification 


1987-88 


1988-89 


1989-90 




N 


Z 




Z 


N 


Z 


Handicapped 


15 


24.6 


37 


71.2 


26 


83.9 


ESL (Bi lingua' ) 


49 


61 3 


49 


64.5 


67 


72.0 


Incarcerated 


33 


78.6 


31 


77.5 


27 


38.0 


Senior Citizen 


65 


68.4 


72 


68.6 


51 


67. 1 


Regular 


410 


51.8 


371 


58.8 


360 


52.6 


Program Total** 


462 


52.8 


560 


61.9 


531 


55.5 



♦Attaining mastery on 75% of their individual objectives. 
**The program totals for 1987-88 and 1 989-90 are undupl icated counts 
(ABE students could only be in one classification). The total for 
1988-89 is a duplicated count. 



An examination of Table 4 reveals the following points: 

• Performance levels among handicapped and ESL students 
rose each year. 

• Performance levels among senior citizens and regular 
AbE students fluctuated, rising between 1987-88 and 
1988-89 but declining between 1988-89 and 1 989-90. 
However, these fluctuations were not dramatic. 

• Performance levels among incarcerated students declined 
marginally between 1987-88 and 1988-89 and substantially 
between 1988-89 and 1 989-90. 
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COOPERATIVE AGREEMENTS 



Another goal of the ABE progran was to have cooperative arrangements with 

various local agencies. Although no longer specified in the grant as an 

objective, documentation verified that such agreements exist with the following 
agencies . 



• Tri-City SER: Jobs For Progress 

• Trinity St. John Community Center 

• Bethel AME Church 

• First Ward Community Center 

• Grace Presbyterian Church 

• Michigan Employment Security Commission (MESC) 

• Neighborhood House Lutheran Social Services 

• Redeemer Lutheran Church 

• Saginaw Community Village 

• Saginaw County Child Development Center 

• Saginaw County Community Action Committee (CAC) 

• Saginaw County Department of Public Health, Aging Services Division 

• Saginaw County Department of Social Services (DSS) 

• Saginaw County Jail 



According to conversations with the program supervisor, these cooperative 
agreements work to the mutual advantage of the ABE program and the respective 
agencies. 



StMMART AND CONCLUSIONS 

During the 1989-90 school year, 978 adult learners received services from 
the Adult Basic Education (ABE) program* Remedial and basic instruction was 
offered in reading, mathematics, English as a Second Language (ESL), and 
Michigan Life Role Competencies (MLRC) at 19 sites located throughout Saginaw. 

The 1989-90 grant contained 11 objectives. Six (54. 5Z) of these 
objectives were met. This represents a decrease over the previous year when 
eight of 11 objectives (72.7Z) were attained. 

However, when considering this, it should be noted that two of the pro- 
gram objectives may have inappropriately high attainment criteria. Specifi- 
cally, these were: setting educational objectives for 100% of the partici- 
pants who received 12 or more instructional hours; and the standard of 15% of 
the participants being rural. 

With specific regard to student achievement, the program did not meet its 
standard. When student achievements are considered by classification, only 
the handicapped students met the performance standard; incarcerated, ESL, 
senior citizen, and regular ABE students did not. 

The chart on the next page summarizes Lhe ABE program's objective 
attainment for 1989-90. 
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Obj ect ive 



Standard 



Supporting Data 



St andard 
Achieved? 



1. 


ESL Instruction 


£ 10% ESL students 


11.8% ESL students 


Yes 


2. 


Service to the 


^> 15% unemployed 


62.6% unemployed 


Yes 




unemployed 


students 


students 




3* 


Service to the 


£ 15* rural* 


7.3% rural 


No 




rural 


students 


students 






Services to the 


Ful 1-t ime pr ogr am 


Full-time program 


Yes 




incarcerated 


for county jail 


provided 








inmate s 






5. 


Services to the 


> 1 0% handicapped 


3* 1% handicapped 


No 




hand icapped 


st udents 


st udent s 




6. 


Services to 


>^ 75% minority 


80.6% minority 


Yes 




minorities 


st udents 


st udent s 




7. 


Services to 


£15% special needs 


31.3% female students 


Yes 




women with 


st udents 


with special needs 






special needs 








o 

0. 


Recruitment 


£10% new students 


53*5% new students 


Ye s 


9. 


Acad emic 


a. 1002 with > 12 


a. 98.8% with 2 12 


No* 




Se rvices 


hours are assigned 


hours were assigned 








obj ect ives 


objectives 








b. 75% will attain 


b. 55. 5% attained 








75% of their 


75% of their 








obj ectives 


obj ectives 




0. 


Dropout 


> 40% will drop out 


4 5.5% dropped out 


No 




Prevention 








1. 


Service to the 


£ 1 0% homeless 


0. 0% homeless 


No 




homeless 


st udents 


student s 





*This may be an inappropriately high standard for an urban based ABE program. 
**The first portion of this objective may be viewed as functionally attained. 

In light of these findings and the findings of the process evaluation, 
recommendations intended to help improve the ABE program have been developed. 
They appear on the following page. 
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RECOHMENBATIOMS 



In light of the 1989*90 process and product findings, the following 
recommendations are offered. 



• The program staff should seek ways to provide service 
to the homeless. 



- One avenue for doing this may be going 
through contacts with the City Rescue 
Mission (as specified in the grant) or 
with the religious and social services 
mentioned in the cooperative agreements 
subsection above* 

- The objective reporting form needs to be 
modified to include each student's home- 
less status. 



• The program staff should consider ways to modify those 
progran objective attainment standards which seem 
unreal istic. 



- The standard for assignment of objectives 

to students who received 12 or more instruct 
tional hours is now 100Z. It could be modi- 
fied to read M at least 98%". This modifica- 
tion would allow for some margin of error 
while still keeping the standard sufficiently 
rigid to guarantee the activity occurs pro- 
gram-wide. 

- Given this program functions in an urban 
environment, a standard of 15% rural stu^ 
dents is arguably high- This and previous 
reports indicate program percents of rural 
students ranging from seven to ten percent, 
which suggests that a standard of "at least 
seven percent" would better suit the program. 



• The program staff should determine what may have caused 
the extreme decline in performance among incarcerated 
students and what could be done to improve their 
performance in the future. 



There w?re staff changes in 1989-90 which resulted, in part, in a new 
teacher being assigned to the incarcerated students. However, this change 
seems insufficient to fully explain their performance decline. 
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• The prog ran staff should continue to review the correct 
reporting processes and instruments for accuracy prior 
to submitting them to evaluation staff • These reviews, 
at minimum, should verify the following: 

- Demographic data describing each student 
is accurate and complete; 

- Students who have received 1 2 or more 
hours of instruction have been assigned 
objectives; and 

- Performance data (attainment of objectives, 
dropping out, etc*) is accurate and complete. 

• A handbook should be written to standardize classroom 
operations in terms of the following: 



- Subject areas taught during each class 
session and appropriate amounts of class 
time devoted to each: 

- Reinforcement to promote student achieve- 
ment; and 

- Proper testing procedures. 
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APPENDIX A 



ADULT BASIC EDUCATION CENTERS 1989-90 



Center Name 

Arthur Eddy Center 
Audra Francis Center 
Bethel AME Church 
Coulter Elementary School 
Community Village 
Elmwood Manor 

First Ward Community Center 

Grace Presbyterian Church 

Kresge iiead Start Program 

Maplewood Manor 

Marie Davis Center 

Merrill Park Elementary School 

Neighborhood House 

Redeemer Lutheran Church 

Ruben Daniels Lifelong Learning Center 

Saginaw Valley Rehabilitation Center 

Saginaw County Jail 

Tri-City SER: Jobs For Progress 

Trinity Center 



Street Address 

1000 Cathay 

2717 Webber 

535 Cathay 

U50 Bridgton 

3200 Hospital Road 

2814 E. Genesee 

1410 N. 12th 

600 Dearborn 

1921 Annesley 

535 S. Warren 

222 S. Weadock 

1800 Grout 

3145 Russell 

382 9 Lamson 

1 1 5 W. Genesee 

919 Veterans' Memorial Pkwy 

208 S. Harrison 

1535 S. Warren 

346 S. 9th 
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APPENDIX B 





TABLE B. 1. 


NUMBER AND 


PERCENT OF 1989-90 ABE 


PARTICIPANTS 








BY GENDER. 




Gender 


N Z 




Male 




447 45.7 






Femal e 




531 54.3 




TOTAL 


978 100.0 




TABLE B.2. 


NUMBER AND 


PERCENT OP 1989-90 ABE 


PARTICIPANTS 






BY RACE/ ETHNIC ITT. 




Aaerican 










Indian 


Black 


Oriental 


Hispanic White 


No Resp. Total 


N Z 


N Z 


N Z 


N Z N Z 


N Z N Z 


4 0.4 


564 5 7.7 


34 3.5 


186 19.0 186 19.0 


4 0.4 978 100.0 



TABLE B.3. NUMBER AND PERCENT 07 1989-90 ABE 
PARTICIPANTS BY AGE. 





Total 


Age 








N 


Z 


13-24 


377 


38.5 


25-44 


388 


3 9.7 


4 5-59 


121 


12.4 


60 and Over 


83 


8.5 


No Response 


9 


0.9 


TOTAL 


978 


100.0 



17 ?3 
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BEST COPY AVAILABLE 



APPENDIX D 



TABLE D. 1. QCARTILE DISTRIBUTION OP OBJECTIVE ATTAIRMENT FOR 
ABE STUDENTS BT CLASSIFICATION— 1989-1990. 





Nuaber 


and Percent of 


ABE Students 








Student 
Classification 


First 
Quartlle 
(0-24. 9Z) 


Second 
Qnartile 
(25-49. 9Z) 


Third 
Quartlle 
( 50-74. 9Z) 


Fourth 
Qnartile 
(75-lOOZ) 




Total 




H Z 


N 


Z 


N 


Z 


N 


Z 


N 


Z of Grand 
Total* 


Handicapped 


0 ( 0.0%) 


2 


( 6.4%) 


3 


( 9.7%) 


26 


( 83.9%) 


31 


( 3.2%) 


Limited Eng. 


9 ( 9.7%) 


3 


( 3.2%) 


14 


(15.1%) 


67 


( 72.0%) 


83 


( 9.7%) 


Incarcerated* 


36 (50. 7%) 


5 


( 7.0%) 


3 


( 4.2%) 


27 


( 38.0%) 


71 


( 7.4%) 


Senior Citz. 

i 


5 ( 6.6%) 


5 


( 6.6%) 


15 


(19.7%) 


51 


( 67.1%) 


76 


( 7.8%) 


Regular ABE* 


108 (15.8%) 


65 


( 9.5%) 


152 


(22.2%) 


360 


( 52.6%) 


685 


( 71.8%) 


Total 


158 (16.5%) 


80 


( 8.4%) 


187 


(19.6%) 


531 


( 55.5%) 


956 


(100.0%) 


Cumulative Total 


158 (16.5%) 


238 


(24.9%) 


425 


(44.5%) 


956 


(100.0%) 


956 


(100.0%) 



*This column/row does not sum to 100.0% due to rounding. 
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